Ultrametricity and clustering of states in spin glasses: A one-dimensional view 
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We present results from Monte Carlo simulations to test for ultrametricity and clustering prop- 
erties in spin-glass models. By using a one-dimensional Ising spin glass with random power-law 
interactions where the universality class of the model can be tuned by changing the power-law 
exponent, we find signatures of ultrametric behavior both in the mean-field and non-mean-field uni- 
versality classes for large linear system sizes. Furthermore, we confirm the existence of nontrivial 
connected components in phase space via a clustering analysis of configurations. 
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An ultrametric (UM) space [H is a special kind of met- 
ric space in which the triangle inequality da-y < dap + dfs-y 
[dafs represents the distance between two points a and 
/3] is replaced by a stronger condition where < 
max{(ia/3, i.e., the two longer distances must be 

equal and the states thus lie on an isosceles triangle. The 
concept appears in many branches of science, such as p- 
adic numbers, linguistics, as well as taxonomy of animal 
species. It is also an intrinsic property of Parisi's mean- 
field solution [3, [1,13] of the Sherrington-Kirkpatrick (SK) 
infinite-range spin glass. Hence, in general, the nature 
of the spin-glass state can be analyzed via clustering 
and ultrametricity-probing methods. 

The nature of the spin-glass state is controversial and 
it is unclear if the mean-field replica symmetry break- 
ing (RSB) picture 0], the droplet picture [7|, |8[, or an 
intermediate phenomenological scenario dubbed as TNT 
@j (for "trivial-nontrivial" ) describes the nature of 
the spin-glass state best. One way to settle the applica- 
bility of the RSB picture to short-range (SR) spin glasses 
is by testing if the phase space is UM. Unfortunately, the 
existence of an UM phase structure for SR spin glasses 
is controversial, mainly because only small linear system 
sizes have been accessible so far. Recent results [Uj sug- 
gest that SR s^^tems are not UM, whereas other opinions 



exist [H, 13, 14, 1^. Thus it is of paramount importance 
to test if SR spin glasses have an UM phase space. 

In this work we approach the problem from a differ- 
ent angle: First, we use a one-dimensional (ID) Ising 
spin-glass with power-law interactions. The model has 
the advantage that large linear system sizes can be stud- 
ied. Furthermore, by tuning the exponent of the power 
law, the universality class of the model can be tuned 
between a mean-field and a non-mcan-field universality 
class. This allows us to test our analysis method on the 
mean-field SK model and then apply it to regions of phase 
space where the system is not mean-field like. We per- 
form a clustering analysis of the data similar to the work 



of Hed et al. ll| to obtain nontrivial triangles in phase 
space and introduce a novel correlator which allows us to 
see an UM signature for low temperatures and delivers 
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FIG. 1: (Color online) Sketch of the phase diagram of the ID 
Ising chain with random power- law interactions. For cr < 1/2 
we expect SK-like infinite- range behaviour. For 1/2 < a < 
2/3 we have mean-field (MF) behaviour corresponding to an 
effective space dimension deft > 6, whereas for 2/3 < a < 1 
we have a long-range (non-MF) spin glass with a ordering 
temperature Tc > 0. Close to a = 2/3 (vertical red line) 
dcff ~ 2/(2o- - 1) fsl]. For a > 1, Tc = 0. 



no signal for high temperatures. Furthermore, we use a 
clustering analysis to search for connected components 
in phase space. The proposed method can be applied to 
any field of science to test for an UM structure of phase 
space, thus making the method generally applicable. 

Our results for low temperatures show that for this 
model the phase space has an UM signature and exhibits 
many phase-space components, the number growing with 
system size in the mean-field as well as non-mean-field 
case. This suggests that for large enough system sizes 
SR spin glasses at low enough temperatures might have 
an UM phase space structure. 

Model. — The Hamiltonian of the ID Ising chain with 
long-range power-law interactions [lil . 17 1 is given by 
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where Si G {±1} are Ising spins and the sum ranges over 
all spins in the system. The L spins are placed on a ring 
and = (L/tt) sin(7r|i — j\/L) is the distance between 
the spins, are Normal random couplings. The con- 
stant c((t) is chosen such that the mean-field transition 



temperature to a spin-glass phase is = 1 

The model has a very rich phase diagram when the 
exponent a is tuned [17[ : Both the universality class and 



TABLE I: Simulation parameters for the ID chain and dif- 
ferent power-law exponents a. L is the system size, N^^ is the 
number of disorder realizations, req is the number of equilibra- 
tion sweeps, Tniin is the lowest temperature and A^r the num- 
ber temperatures used in the exchange Monte Carlo method. 
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the range of the interactions of the model ean be contin- 
uously tuned by changing the power-law exponent, see 
Fig. [TJ In this work we study the SK model [ct = 0, 
Tc = 1] to test our analysis protocol, as well as the ID 
chain for a = 0.75 [T^ - 0.69] and 0.85 [T^ ~ 0.49] [H; 
both corresponding to the non-mean-field regime. We 
choose two values of a to be able to discern any trends 
when the effective dimensionality is reduced. 

Numerical details. — We generate spin-glass configu- 
rations by first equilibrating the system at T f« 0.4Tc us- 
ing the exchange Monte Carlo method , i.e., T = 0.4 
for the SK model, 0.27 for cr = 0.75 and 0.20 for 
a = 0.85. Once the system is in thermal equilibrium 
we record states ensuring that these are well separated 
in the Markov process and thus not correlated by measur- 
ing autocorrelation times. In practice, if we equilibrate 
the system for Toq Monte Carlo sweeps, we generate for 
each disorder realization lO'^ states separated by Toq/lO 
Monte Carlo sweeps. We test equilibration using the test 
presented in Ref. [18[; see Table [I] for simulation details. 

Analysis details. — We use an approach closely re- 
lated to the one used by Hed et al. llj. M = 10'^ equilib- 
rium states at r « 0.4Tc — to probe deep within the spin- 
glass phase — are sorted usin g th e average- linkage agglom- 



erative clustering algorithm [2^ : Distances are measured 
in terms of the hamming distance = (1 — | (7,3.^ |), where 
qap = J2i is the spin overlap between states 

{S"} and {S^}. The clustering procedure starts with M 
clusters containing each exactly one state. Distances be- 
tween clusters are introduced, which are initially equal 
to the distances between the corresponding states. Itera- 
tively the two closest clusters Co and Cf, are merged into 
one cluster Cd, reducing the number of clusters by one. 
The distances of the new cluster Cd to the other remain- 
ing clusters have to be calculated: The distance between 
two clusters is the average distance between all pairs of 
members of the clusters. The procedure is iterated until 
one cluster remains. The sequence of mergers can be dis- 
played by a tree, referred to as a dendrogram. The root 
of the dendrogram corresponds to the last cluster, while 
the leafs correspond to the initial states, see Fig. [21 Fur- 




FIG. 2: A dendrogram obtained by clustering 100 configura- 
tions (see text) for a sample system with a = 0.0 and L = 512 
at T = 0.4 together with the matrix d^^ shown in grey scale 
(distance is black). The order of the states is given by the 
leaves of the dendrogram (figure rotated clockwise by 90°). 



thermore, we also show in Fig. [2] the distance matrix dap 
having ordered the states according to the leaves of the 
dendrogram. The matrix elements are encoded in gray 
scale (black corresponds to zero distance). The complex 
phase-space structure is clearly visible: The matrix has 
a block-diagonal form, the blocks again being subdivided 
in a block-diagonal structure. 

To analyze the matrix quantitatively for ultrametricity, 
we randomly select three states from different branches of 
the tree [llj and sort the distances: dmax > earned > dmin- 
We compute the correlator 



K=id„ 
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where Q{d) is the width of the distribution of distances. 
Note that the definition of K in Eq. ^ differs from the 
definition used in Ref. prj where the normalization is per- 
formed with dmin- Our choice ensures that any apparent 
change of an UM measure is scaled out, which is just 
caused by a width change of the distance distribution. 
The definition used in Ref. [ll| can only tell if there is 
no ultrametricity, i.e., a random bit string will also show 
an UM response. The definition in Eq. ^ alleviates this 
problem: For T > Tc (or a random bit string) there is no 
UM signature in whereas for T Tc we see a clear 
UM response for the SK model. Thus we are able to dis- 
cern between "trivial ultrametricity," which occurs from 
equilateral triangles at T > Tc, and a true UM phase- 
space structure. If the phase space is UM then we expect 
d„,^^ = dmed for L ^ 00. Thus P{K) 5{K = 0) for 
L 00 We have also computed P{K) for a Migdal- 
Kadanoff spin glass [2^ finding no UM signal for systems 
up to = 149798 spins, as one would expect. 

We also analyze the connected components in phase 
space (visible in the distance matrices dap) by extend- 
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ing the approach of Kelley et al. [2J|. During the 
I'th iteration of the clustering algorithm one encounters 
M{i) = M — i clusters. Thus the goal is to find the 
number of clusters which represents the data best corre- 
sponding to the highest-level blocks in the ordered dap 
matrix. To obtain a better resolution at the scale of small 
distances, we use a logarithmic scale da/3 1 — log daf3, 
normalized to values [0,1) [2^. To measure the com- 
ponent property of the configuration space, we calcu- 
late for each cluster F = {ai} obtained during the algo- 
rithm the average distance within the cluster ( "spread" ) 
spr = 2X;a^/3gr^a/3/|r|(|r| - 1). Here |r| is the num- 
ber of states in the cluster F. Then, for each iteration i, 
the average spread spj among the M{i) clusters is calcu- 
lated. Once the clustering analysis is completed, all M 
average spread values are normalized to lie in the inter- 
val [1,M — 1], resulting in spf°'™. For each realization 
the minimum Afmin of 'spf°™ + ^M{i) as a function of 
M{i) is determined, where 7 is a sensitivity parameter 
(the method of Ref. [2J| corresponds to 7 = 1). Then 
nc ~ Mmin is the number of phase-space components. 
Note that the larger 7 is, the fewer components are found. 
Since a paramagnet should exhibit only one component, 
we determine for each system size L 7(L) such that for 
M = IQ^ random bit strings [T = 00), averaged over 10^ 
runs, on average 1.01 components are obtained [i^. 

Results. — In Fig. [3] the distribution P{K) is shown 
for (7 = (SK model), 0.75 (non- mean- field), 0.85 (non- 
mean-field) for T fa OATc- In all three cases, P{K) seems 
to converge to a delta function for L 00. This is 
clearly visible when looking at the variance of the dis- 
tribution which decays with a power-law of the system 
size (see Fig. |4]). Note that P{K) does not change with 
system size close to Tc [inset to Fig. [3fa)]. A similar 
lack of divergence has also been found for simulations for 
a = 4.0 in the SR universality class [inset to Fig. [3l^c)]. 
For random bit strings [inset to Fig. ^h)] the correla- 
tor also shows no sign of UM. Therefore, the correla- 
tor [Eq. ([2|)] can clearly distinguish between "trivial" 
ultrametricity — which is due to equilateral triangles — 
and ultrametricity created by a complex energy land- 
scape. We have also performed an equivalent analy- 
sis by replacing the spin overlap qap by the link over- 

lap = iVb-'nd.E.<, S^SfS^S^. In this case, for aU 
values of a, P{K) does not converge to a delta func- 
tion. This is to be expected, since a different approach 
is needed [3l to obtain evidence for UM using q^^^. 

In Fig.[5]the number of components nc is shown for the 
SK model as function of L for different T. Below Tc nc 
increases with L, while for larger T it decreases. Other 
values of a show a similar behavior (not shown). Inter- 
estingly, nc is largest in the spin-glass phase and close to 
Tc (inset to Fig. [5]). The reason is probably that at higher 
T more energy landscape valleys are accessible, includ- 
ing those who have high-lying minima, still separated by 
energy barriers rarely overcome. For even higher tcmpcr- 
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FIG. 3: (Color online) Distribution P{K) for different system 
sizes (all panels have the same horizontal scale), (a) Data 
for the SK model. The distribution diverges for K thus 
signaling an UM phase structure. Inset: For T ~ Tc no di- 
vergence is visible, (b) Data for the ID chain for a — 0.75 
(non-mean-field universality class). The distribution diverges. 
Inset; For random bit strings the distribution shows no diver- 
gence, (c) a = 0.85 (non-mean-field universality class). The 
distribution diverges. Inset: For a = 4 (corresponding to a 
system with des < 2 the distribution shows no divergence. 



atures even more states are highly populated, leading to 
one big component in the energy landscape. The exact 
peak position shifts slightly with a. 

Summary and discussion. — We have studied numer- 
ically the low-temperature configuration landscape of a 
ID long-range spin glass with power-law interactions 
characterized by an exponent a. By using a hierarchi- 
cal clustering method and analyzing the resulting dis- 
tance matrices we have studied the UM properties, as 
well as counted the phase space components. For this 
purpose we have introduced a novel way to quantify ul- 
trametricity and we have extended a method to count 
components by analyzing the distance matrix structure. 
We observe that for a values spanning the infinite-range 
SK universality class (cr = 0) to the non-mcan-field uni- 
versality class (cr > 2/3) an UM organization and a com- 
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FIG. 4: (Color online) Variance of P{K) as a function of L for 
different cr. The data are well fit to a power-law decay ~ b/L" 
(dashed lines) with c = 0.39(10), 0.16(2), and 0.13(1) for 
a = 0.0, 0.75, and 0.85, respectively, suggesting a divergence 
for K —t for cr < 1. We have also computed the "fraction of 
UM instances," (those which exhibit J^'^ Pinsta.ncc{K) dK > 
0.5, not shown). For larger system sizes, this fraction grows 
with the system size for a < 1 values. Hence the results 
for 2/3 < a < 1 are not due to rare strongly-ultrametric 
instances. 
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FIG. 5: (Color online) Number of phase-space components 
nc in the SK model as a function of system size A'^ for dif- 
ferent temperatures. For T < Tc (full symbols) the number 
of components grows considerably for increasing system size 
L, whereas for T >Tc (open symbols) the number of compo- 
nents remains approximately constant as a function of L. The 
inset shows the number of components as a function of tem- 
perature T for L = 512 for different exponents a. The data 
for all a are qualitatively similar: for T ^ Tc (dotted lines) 
the number of components is much larger than at T ^ Tc- 



plcx clustered landscape seem to emerge for the system 
sizes studied. To check if these results persist at larger 
length scales, it would be of interest to study even larger 
systems |27[. This important since the crossover to any 
putative UM behavior presumably might depend on the 
system size. 
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